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. ABSTRACT • * ' 

Teaching stratqgles used by precepters at a ' 
hospital-based faaily aedicine center vere investigated yith seven 
preceptors ;wHo had ^previous teaching experiences and were board 
.cisrt'ified (six in faiiily iediciner. A third-yisar senior resident 
presented and discussfed tvo patient cases to the preceptors in 
separate oiie- to-one teaching sessions, ahd the j^receptors nere told 
tD treat the cLse as they irould for a first-year resident* The senior 
resident constructed- fictitious history, physical, exaaination, and 
treatnent information for an acute patient prqblea (unaibiguous case) 
and a chronic patient problem (ambiguous case)' • Certain points of 
information judged critical to diagnosis and treataent vere withheld- 
but would be given to the preceptor upon request. Preceptor views of 
ttie objectives .for the teaching conference were also elicited* 
Preceptors were found to differ on the questioning strategies used; 
on each case the individual preceptors varied on the number of lower 
and higher order questions asked. The preceptors required more time 
and aslced more questions for the acute problem case. However, the 
preceptors who asked many or few questions kept the same relative 
•pattern for both cas.es^ There- appe^ared to be a correlation between, 
^use of treatment questions and preceptor effedtiveness. Preceptor 
effectiveness was also measured by rank ordering by' a faculty member 
based on pre-identified critetia. Based on these rankings, it is 
suggested that organization and specificity of preceptor goals may be 
a variable related to effectiyenesis. In debriefing sessions, 
preceptors requested ,more information on their teaching performance 
and expressed 'interest in learning about alternative teaching styles* 
(SW) . ' 
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The field of clinical teaching is receiving emphasis in the medical and pro- 
fessional education literature .as the helping ^professions increasingly 

y 

recognize the need for systematic training of precious teaching resources/ 

* 10 

Daggett (1979) reviewed the study of clinical teaching and found a need 

for more^ research conducted in clinical settings, focused on what physicians 

actually do, the type of interactions that occur and the determinations of 

t 

what is important to be taught. < ^ 



Initial studies of the one-to-one teaching -and supervising (precepting), 
have borrowed from the research in classroom teaching and have attempted 
to identify critical variables that affect instructor ratings in clinical 
settings (e.g., Irby, 1978)1 Recent literature in clinical, decision-^king 
and clinical judgment suggest that these variables should b^ further defined 
particularly in the area of questions, feedback, and task definition (Elstein, 

Shulman, Sprafka, 1978). An exttapolation of -the clinical judgment studies 

to the clinical teaching domain would indicate that the variables such as 
cue acquisition, and hypothesis generation represent skills tb^t a preceptor 
must notice. It has. been postulated that the effectiveness of any problem 
Solving strategy is affected by the particular factors of a presenting pro- 
,hlem. Similarly,- it can be hypothesized that specific clinical problems inter- 
act with and affect ^election of precepting (supervising) strategies • 

"PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 

- 1 - O ""[PJ^E EDUCATIONAL RESOURCES 

C INFORMATION CENTER (ERIC)." 



OBJECTIVES ^ 

♦ • -# ' 

To study the phenotaenon of preceptor behavior-/ a pilot test was conducted 
using one senior resident and seven preceptors at a hospital-based Family 
Medicine Center^- The purpose of the study was to 

■ . ■ '.A 

1. Investigate- differences that exist in teaching 
strategies among preceptors who are presented 
with the saine -case materials by the same resx-* 

dents separate -teax:hing sessions. T 

2. Identify differenceis in teaching styles that 
exist when presentors are presented with cases 
that systematically vary in content, specificity 
and problem type. 

— 3. Elicit preceptor veiws of the purpose of their 
teaching sessions. 

4. Explore how etne- information derived from the study 
can be used to effect changes in clinical teaching 

training. ' l. 

The sampling plans were developed to include one preceptor from each of the ten 
(10) . clinic sessions held weekly at the program. Due to scheduling constraints, 
three (3) preceptors were excluded. The preceptors had previous teaching experiences 
and were Board Certified (six in Family Medicine).. The group include four (4) full- 
time and three (3) part-time faculty members. 



METHOD , ^ 



A third-year senior resident presented and discussed two patient cases to seven 
(7) preceptors in separate one-to-one teaching sessions in the setting and. . 
in' the manner identical to current clinical practice. The only exceptions 
were that the sessions were tape-recorded, the preceptors were in formed 
that they were in a study, and one-half of the preceptors were asked 
questions about teaching strategy before the second case presentation. 
The preceptors ware told to -treat the case as. they would for a first-year 
resident. The cases were counter-balanced . to control for order effects. 

INDEPENDEMT VARIABLES 
The senior resident constructed fictitious history, physical, examination 
and treatment information for an acute patient problem (unambiguous case) 
and a chronic patient prbblem (ambiguous case). The case presentation 
(history, physical,, problem list and plans) w,re formulated to represent the 
knowledge of a first-year resident. Certain points of information judged 
critical to cUagnosis a'rS' treatment were wxcflld. It was anticipated that 
th9 preceptfrl^ould ask^for this information during the case presentation. 
• The information j|ould. only be given upon direct request of the preceptor.- 

A set of questions and promptings aimed at eliciting the preceptors objec 
• tives for the teaching conference were also developed. The' case information, 
questions and presentkion techniques were pre-test'^d with -a senior -faculty. 



member for accuracly^and" confirmation of judgments. In addition, a 
.faculty member was -asked to read transcripts c<f the teaching conferences, 
construct criteria for rating the conversations and rank order the seven 
conversations for each case presentation. 

DEPENDENT VARIABLES _ , 

Dependent variables included numbers of exchanges between preceptor and 
resident, numbers and types of questions asked, numbers of responses- 
matching anticipated responses, length of teaching sessions, and statements 
by preceptors on the goals of the conference. The category types of quea- ' 
tions were sub-divided into higher and lower order questions. Next those 
questions were further divided into questions aimed at cue acquisition, 
hypothesis generation, cue interpretation and treatment. 

■ ^ ANALYSIS 

TranscT^lpts of the sessions were made from tape recordings. Specif ication? 
for categorizing each question type were constructed, and performed by the 
author. Data was siimmarized by preceptor and by case* The quantitative 
data was examined l?y analysis of variance, Chi Square and T test procedures.. 

" ^RESULTS 

Preceptors were found to differ on the questioning strategies used. Chi Square 
tests reveal that on each case presented the individual preceptors varied 
among .themselves on number of lower and higher order questions asked. Inspec- 
tion of the data suggests a wide ran^ of differences among preceptors on the 
depend'ent measures. . " 



There also appears to be differences across the group of preceptors th^t 
can be attributed to the nature of the presenting case. Tables One and 
Two summarize the mean- score of the preceptor group on each of the dependent * 
measures. Analysis u^ing paired tests indicates that the preceptors required 
more time and asked mor'e quesions when Case One yas presented.? ^.05. Iftien 
question categories are analyzed, the only difference suggested is in the 
area of treatment quest?>ons (P^.b7). Chi Square tests reveal no differences 
among individual preceptors when they are compared with themselves on Cases 
One and Two. The results suggest that while the tjrpe of case alters preceptor 
behavior in the sense that less questions ar^ asked, it does, not alter basic 
variations in style (eg., the preceptors e AvLng many or few questions keep 
the same relative pattern across cases). The exception appears to be the 
interaction of Case tjrpe and treatment question. ^ 

Another way to view the results- is to construct a profile of questioning 
strategies used by the preceptgr group in each case presented. A profile 
wac developed by totaling the proportion of questions asked in iaach question 
category. The analysis revealed t^iat there is similarity between cases in 
the precentage of questions, used from each category. The only significant 
difference is that a greater proportion of questions were asked. in the 
treatment category for Case One. 

Preceptor effectiveness was measured in two ways. The first strategy 
counted the number of anticipated responses that the preceptor, in fact, 
correctly made. The second method used was a ranking ordering by a faculty 
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member based on his own p re-identified criteria. While the Sample size ■ 
' i5 too small to permit definitive results, it does suggest that there 
is a correlation between the two measures (.68 for Case^One and .43 for 
Case Two*).* Further, when each of these measures is correlated with ^ 
questioning strategies, there appears to be a correlation between use of 
treatment questions and preceptor effectiveness. 

Preceptors varipd in their answers to questions regarding purpose or 
objectives in the teaching conferences. The answers ranged from vague 
responses (i;e. , "Teach the resident.*." or "Supply infortnatioa. . .") to 
very specific replies concerning, students' organization of. problems. 

Examination of the highest and lowest rated preceptor conferences suggests 

char~ar ga^cri."srarionr an~d~speci f ic ity~of goals be a variable" related" to etfec- 

tiveness. ' - . 

The results of this pilot study must be considered preliminary, but 'would 
suggest that while there are differences in individual preceptor's styles, 
case factors can account for some changes la- teaching strategy. Certain 
questioning strategies seem to b6 more effective In eliciting data pre-* 
selected as important. • ' . - 
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; IMPLICATION S 

Previous studies oE clinical teaching in actual clinic settings lacked 
control of case details and, thus', preceptors wete compared under different 
conditions. This~study would suggest * hat teaching is altered by the 
nature of the presenting case. 

Earlier studies have suggested that problem-solving strategies are im- 
portant tools of diagnosis and should .a taught to students. This study^. 
suggests that these factors can be used in a clinic precepting conference 
asca method for examirdng teaching styles. 

\ ^ • - 

Preceptors, in debriefing sessions, requested more information on their 

teaching.j)erformance and expressed interest in learning about alternative 

teaching styles. Meleca (1978) states that one -of the problems identified 



.by the clinical teaching literature is the lack of exposure to formal teaming 



•1 



practices and variety of methods by qlinical supervisors. Examining tran. 
scripts of case presentations appears to be a viable method of self-asses|ment 
of teaching. The fact tJiat' preceptors varyTSi their effectiveness and that 
the variability may be due to case fetors is consistent with the studies in 
cl,inical reasoning; Elstein (1978). - This would suggest that the use of group- 
meetings for preceptor conferences are beneficial because they permit variety 
of views to be expressed and weaknesses identified. 



In addition, just as clinical judgment ^studies emphasize problem-solving 
heuristicsand protocols for students,' preceptors may -benefit from teaching 
protocols and examination of efficieht teaching guidelines. Another variable 
that could be manipulated and studied in clinical teaching is the order in 
^he questioning stTcategy. This study suggests that the" proportion of question 
types asked is stable; Of intarestjwould .be ah examination of -the effects 
when preceptors are required to use a prescribed order. Jor example, in this 
study, preceptors tended to move from cue questions toward hjnpothesis and 
treatment questions. If h3^othesis. questions were emphasized earlier ^ one 
might predict a different set of responses from the clinical teachers. 

Attempts to measure teacher performance face the traditional problem of cor- 
relating ability to execute methods with the ability tc select salient features 
''in any given teaching task* \ 

3 

This study attempted to use preselected critical features of a case as a criterion 
measure. Further research is needed to specify the nature of clinical problems * 
had the .efficacy of training with ^altemat-ive precepting strategies to meet the 
problems. 
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PROFriE OF TWO CLINICAL TEACHtHG SESSIONS N=7 



:,. ^ VARIABLE . . 


, CASE.l- 
ACUTE PROBLEM 


CASE 2 ' 
CHRONIC PROBLEM 


BETWEEN GROUP 
P DIFFERENCE 


2/TAIL 
PROBABILITY . 


Timejfor. Conference '» 


X =8.9 minutes. . 


— — ( 

8.1 minutes 


.4.97 


.05 ' 


: Number of Exchanges 
5 * ^ 


X =28 exchanges 


X »=.20 exchanges 


2.55 


. .13 , ^ '. 


NiimbGr of rHiG55fions 


X = 15.6 questions 


X = 10,6 questions 


2,48 


.14 

% ** * 


' Number -of Lower Order Ques- 
;\- tions 


X = 9,86 questions 


X = 7,29 questions^ 

. . ■ ,. ■ < ~ - 


2", 52 


• 13 


Number of Higher Order Ques- 
tions 


X «= 5.71 questions 


X = 3;57 questions. 


'.72 ' 


. .41 . ' 


I Accfuisltion Questions 


• 

X » 5^28 questions 


X « 4,28 questions 


.67 


.42 


1- Interpretation Questions 

1; 


X 3,00 questions 


X = -2,14 questions 


.89 


.36 


[ Hypothesis - Generation 
1, Quest ions 


X « 2,71 questions 


X « 2,71 questions 


.00 


r.oo 


i treatment Questions 

1 ■ - ■ 

■y ■ 


X =3.42 questions 


X = 1,00 questions 

c 


4.29 


.06 



♦ 

— ^ PAIREDJEJEEST- OF ' DIFFERENCES BETT^EEW CASE I ACUTE 

AND CASE 2 CHR0NIC~0N-SEL-ECTED-VARIABLE; 

* 

VARIABLE • • T STATISTIC ' P VALUE 



Teaching Time 

• 


'2.24 






.067 


Conference 


2.60 






.• 04 


0 

Exchanges 


2.05 


<• 




/08 


Questions 


2.53 






. 04 


Lover order questions 


2.09 






08 


Higher order questions 


1.81 




♦ 


. 12 


Cufe Acquisition questions' 


1.00 . 






. 35 


Cue Interpretation questions 


I.V9 






• . : . 14 


Hypothesis questions 


0.00 






1.00 


Treatment questions 


2.19 






n7 



12 



- 10 - 



p^J^r, ^; 
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. PROFILE OF 'TWO CLINICAL TEACHING 
CASE PRESENTATIONS 

. •* ... 








COMPiiRISON OF THE PROPORTION OF 
QUESTIONS IN EACH CATEGORY 












Differences Between 


1 and 


2 V 




ipfPI^OF QUESTION 


• CASE 1 


CASE 2 2 F 


Value 






' Cue Acquisition 


'33. 9Z 


39.5% 1.729 


.10 


f 




' Cue Interpretation ^ 


^ 19.3% 


19.0 .16 


N.S. 






. Hypothesis Generation 


14.4% 


i%l .13 


N.S.. 






Treatment 


22.0 


9.2-, 6.063 


.001 






— r ' 

other. 


6.4 


5.3 .85 


N.S. 




\' 


Lower order questions 


63.3 


- r ^ 
67.1 


— 






/s^Hlgher order questions 


36*;7 

* \ 


^ 32.9 . — 

. - : h ■ ■ • 


— 




V ' « ' 

it- 

'. 

*v . . • * 


« 

• 


4 

t 


" ? 

' ' " • . '• 


•V 

< 


• : 


^ '"^ ' - * • 


» 


V 

t 


- ii - • 

- * • ^ 
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• 
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CORRELATION OF 


RATINGS TO SELECTED VARIABLES 




f ' • 










VARIABLE » 


TOTAL 1 1 
CASES 1 CASE 1 , 


CASE 2 . 








N=7 


> 

/ • 


Teaching Time ' 


.21 «• .20 ' \ 


.31 




Coaference*Time ' 


-.18 ' .15 . ', 


.34 


- " * 


Exchanges | 


.22 \ .19 • ' 


.30 




Questions 


.12 \ ' .05 1 


.24 




Lower order questions 


1 -.28 ' , -.51 ' , 


-.17 




Higher order questions 


< .35 ' .30 - 


;49 ■ ' 




Cue acquisition questions 


'1-.47 « -.47 ', 

1 1 


-.50 




Cue interpretation ques- 
tions ' ' 


1 .02 ' .08 - , 


.04 


X 


Hypothesis questions 


', .24 \ .05 


' .57 . . / 


* 


— — — ^ — rr-- 

Treatment questions 


', .37 '1 .30 


' .76 • '.'.'.] 


: v' ♦ 
p 


Expected response 


'/;50 • • .68 


1 .43 . ■ ■ ^ 


/ • 

i ^ 

r 1^ 




9 

14"- 





V 



CORRELATION OF CORRECT RESPONSES 
- ^ TO SELECTED. VARIABLES 





•s. 


VARIABLE' 


TOTAL 
CASE 


' • CASE 1 


CASE. 2 








Teaching Time' 


• 26 


. -.20 


- .44 




i . 
i 

^? 




Conference Time 


.18 


-.23 

c 


.31 


. I' • •,.-;.£ 


.A 

f . 

''a ^ 

», 




number o£ Exchange 


.40 


.45 


.22 








Questions 


•25 


. .27 


.02' 






• 


Lower order quesr. - 
tions 


J. JZ> 


20 


.23 




* 

u 


i> * 


Higher order 
•questions 


,.09 


.IX 


-.19 


* ^- . 






Cue acquisition 
questions 


.15 


.01 


.15 


* • ^ IT • 






Cue^ interpret at ion 
questions * 


-.05 


.11' 










l^otAesis ques- 
tions. ' • • 


-.07 ■ 


-.16^ 


■ -iOi • V 


^ ».V«*>^-. •'^ 5- 




< 


7 

Treatment ques- . 
tions 


.54 


.51 


.55 








* Rating 


.50 


.68 


.43 




'{ 
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CHI SQUARE TEST T 
comparing differences between preceptors on questioning strategies. 

Value Prob. 



Lower order questions vs higher order questions - 
across cases 

Lower order ^questions vs higher order questions - 
Case 1 • 

Lower order questions vs higher order questions' - 



33.62 .000 
* 18.477 .005 

18.867 .004 
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